1. In a computer system that includes a results evaluation sub-system for 
evaluating test results generated by a test, a method for determining if a test was successful, 
the method comprising the following: 

an act of receiving actual test results, the actual test results being generated as 
a result of performing a test in a test environment; 

an act of receiving one or more expected test results from a results retrieval 
sub-system, each of the one or more expected results being results that can occur 
when the test is successfully performed in the test environment; and 

an act of evaluating the actual test results against the one or more expected 
test results to determine if the test was successfully performed in the test 
environment. 

2. The method as recited in claim 1, wherein the act of receiving actual test 
results comprises an act of receiving actual test results that were collected at a results 
collection sub-system. 
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£j 3. The method as recited in claim 1, wherein the act of receiving actual test 
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^ 5/3 4. The method as recited in claim 1, wherein the act of receiving actual test 

O results comprises an act of receiving actual test results generated from testing a software 

object. 
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5. The method as recited in claim 1, wherein the act of receiving one or more 
expected test results from a results retrieval sub-system comprises an act of receiving test 
results that were generated in a environmental having one or more environmental conditions 
that match the test environment. 

6. The method as recited in claim 1, wherein the act of receiving one or more 
expected test results from a results retrieval sub-system comprises an act of receiving 
expected test results from a plurality of test entries in a results database, the expected results 
from each test entry being results that indicate the test was successful in the test 
environment. 

7. The method as recited in claim 1, wherein the act of receiving one or more 
expected test results from a results retrieval sub-system comprises an act of a network 
message from a second computer system that includes the results retrieval sub-system, the 
second computer system being network connectable to the computer system. 

8. The method as recited in claim 1, wherein the act of evaluating the actual 
test results against the one or more expected test results comprises an act of comparing field 
values in the actual test results to field values in the expected test results. 

9. The method as recited in claim 1, wherein the act of evaluating the actual test 
results against the one or more expected test results comprises an act of determining if one 
or more actions were performed. 
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10. The method as recited in claim 9, wherein the act of determining if one or 
more actions were performed comprises an act of determining if one or more actions were 
performed in a specified order. 



1 1 . The method as recited in claim 1 , further comprising: 

an act of receiving environmental data representing the test environment; and 
an act of sending the environmental data along with a test type indication to 
the results retrieval sub-system. 

12. The method as recited in claim 11, wherein the act of receiving 
environmental data representing the test environment comprises an act of receiving 
environmental data from an environment discovery module. 

13. The method as recited in claim 11, wherein the act of receiving 
environmental data representing the test environment comprises an act of receiving 
environmental data from the test module that executed the test. 




results update including at least the actual test results. 



14. The method as recited in claim 1 , further comprising: 



an act of sending a results update to the results retrieval sub-system, the 
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1 5. The method as recited in claim 1 , further comprising: 
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an act of sending evaluation results to an analysis sub-system, the evaluation 
results including at least the actual test results and indication of whether the test was 
successful 
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16. In a computer system that includes a results retrieval sub-system for 
retrieving expected results, a method for retrieving expected results that are to be used to 
determine the successfulness of a test, the method comprising the following: 

receiving environmental data representing that a test was performed in a test 

environment; 

selecting one or more expected results from a results database based on the 
received environmental data, each of the one or more expected results being results 
that can occur when the test is successfully performed in the test environment; and 

sending the selected one or more expected results to a results evaluation sub- 
system in response to receiving the environmental data. 



17. The method as recited in claim 16, wherein the act of receiving 
environmental data representing that a test was performed in a test environment comprises 
an act of receiving environmental data from a results collection sub-system. 



^ 18. The method as recited in claim 16, wherein the act of receiving 
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[g environmental data representing that a test was performed in a test environment comprises 

s < I ^ 2 an act of receiving environmental data from a results evaluation sub-system. 

8 - * O H U3 

g£u<§ 19. The method as recited in claim 16, wherein the act of receiving 



-Of—, 

* 2-^ 



< 



environmental data representing that a test was performed in a test environment comprises 
an act of receiving environmental data that represents the test environment. 
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20. The method as recited in claim 16, wherein the act of receiving 
environmental data representing that a test was performed in a test environment comprises 
an act of receiving environmental data from a second computer system that includes the 
results evaluation sub-system, the second computer system being network connectable to the 
computer system. 

21. The method as recited in claim 16, wherein the act of receiving 
environmental data representing that a test was performed in a test environment comprises 
an act of receiving a test type along with the environmental data, the test type indicating a 
specified type of test was executed in an environment represented by the environmental 
data. 



22. The method as recited in claim 21, wherein the act of receiving a test type 
along with the environmental data, the test type indicating a specified type of test was 
executed in an environment represented by the environmental data comprises receiving an 
indication that a software object was tested in an environment represented by the 
g environmental data. 
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O environmental conditions represented in the received environmental data. 
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24. The method as recited in claim 16, wherein the act of selecting one or more 
expected results from a results database based on the received environmental data comprises 
an act of selecting one or more expected results having a corresponding an environmental 
condition that must match an environmental condition contained in the received 
environmental data. 

25. The method as recited in claim 16, wherein the act of selecting one or more 
expected results from a results database based on the received environmental data comprises 
an act of selecting one or more expected that with corresponding environmental conditions 
having a specified commonality to environmental conditions contained in the received 
environmental data. 

26. The method as recited in claim 16, wherein the act of selecting one or more 
expected results from a results database based on the received environmental data comprises 
an act of selecting a plurality of expected results from the results database. 

27. The method as recited in claim 16, further comprising: 

an act of receiving a results update from the results evaluation sub-system, 
the results update included actual test results from a test executed in a new test 
environment; and 

an act of storing the actual results in the results database such that the actual 
results can be used to determine the successful of subsequently executed tests. 
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28. A computer program product for use in a computer system that includes a 
results evaluation sub-system for evaluating test results generated by a test, the computer 
program product for implementing a method for determining if a test was successful, the 
computer program product comprising one or more computer-readable media having stored 
thereon computer executable instructions that, when executed by a processor, cause the 
computer system to perform the following: 

receive actual test results, the actual test results being generated as a result of 
performing a test in a test environment; 

receive one or more expected test results from a results retrieval sub-system, 
each of the one or more expected results being results that can occur when the test is 
successfully performed in the test environment; and 

evaluate the actual test results against the one or more expected test results to 
determine if the test was successfully performed in the test environment. 



29. The computer program product as recited in claim 28, further comprising 
^ computer-executable instructions that, when executed by a processor, cause the computer 
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O 30. The computer program product as recited in claim 28, further comprising 

computer-executable instructions that, when executed by a processor, cause the computer 
system to perform the following 
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send a results update to the results retrieval sub-system, the results update 
including at least the actual test results. 

31. The computer program product as recited in claim 28, further comprising 
computer-executable instructions that, when executed by a processor, cause the computer 
system to perform the following 

send evaluation results to an analysis sub-system, the evaluation results 
including at least the actual test results and indication of whether the test was successful. 

32. The computer program product as recited in claim 28, wherein the one or 
more computer-readable media are physical media. 

33. The computer program product as recited in claim 28, wherein the one or 
more computer-readable media include system memory. 
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34. A computer program product for use in a computer system that includes a 
results retrieval sub-system for retrieving expected results, the computer program product 
for implementing a method for retrieving expected results that are to be used to determine 
the successfulness of a test, the computer program product comprising one or more 
computer-readable media having stored thereon computer executable instructions that, when 
executed by a processor, cause the computer system to perform the following: 

receive environmental data representing that a test was performed in a test 
environment; 

select one or more expected results from a results database based on the 
received environmental data, each of the one or more expected results being results 
that can occur when the test is successfully performed in the test environment; and 

send the selected one or more expected results to a results evaluation sub- 
system in response to receiving the environmental data. 

35. The computer program product as recited in claim 24, further comprising 
computer-executable instructions that, when executed by a processor, cause the computer 
system to perform the following: 

receive a results update from the results evaluation sub-system, the results 
update included actual test results from a test executed in a new test environment; 
and 

store the actual results in the results database such that the actual results can 
be used to determine the successful of subsequently executed tests. 
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36. The computer program product as recited in claim 34, wherein the one or 
more computer-readable media are physical media. 

37. The computer program product as recited in claim 34, wherein the one or 
more computer-readable media include system memory. 
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